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ABSTRACT 

The predictive validity of the Graduate Record 
Examinations (GRE) aptitude test has been investigated for foreign 
students at the University of Kansas. A total of 148 students whose 
first language was other than English 'were selected for this study. 
Verbal and quantitative scores on the GRE, field of study, sex, and 
year of initial enrollment were used as predictors. The grade point V 
average (GPA ) in the graduate school was considered as the criterion 
The results revealed that foreign students scored significantly lower 
than American students on the GRE scores and the GPA. Poor 
correlation between the GRE scores and the criterion suggested that 
the, GRE aptitude test is .not the most appropriate way to predict 
academic performance of foreign students. During multiple regression, 
field of study and verbal scores, on the GRE were found to be 
significant predictors of the GPA. High within-group variability, 
among foreign students suggested the study of subgroups formed on the 
basis of language, culture,-, or the geographic location. The use of 
separate norms for foreign students was also found desirable. 
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Abstract 



The predictive validity of the GRE Aptitude test has been 
investigated for foreign students at the University of Kansas. 
A total of 148 students whose first language was other .than 
English were selected for this study. Verbal and quantitative 
scores on the GRE, field of study, sex," and year of initial 
enrollment ware used as predictors . The GPA in the graduate 
school was considered as the criterion. . Tha/results. revealed 
that* foreign students scored significantly low4r than "American 
students- on the GRE scores and the GPA. Poor correlation 
between the GRE scores and tjie criterion suggested that the 
GRg Aptitude test is ' not'W most appropriate way to predict 
academic performance of foreign students. During multiple 
regression, field pf study and verbal scores on the GRE were 
found significant predictors of the GPA. The study suggested 
to investigate subgroups of foreign students formed on the 
basis of language, .culture, or the geographic location. The 
use of separate norms for foreign students was also felt 
desirable. 



• The Differential Predictive Validity of the GRE ' ^ 
Aptitude Test for Foreign students 

♦ % 

• The predictive validity of the, GRE aptitude test for minority 
groups has long been questioned. Concern about possible test 'bias has 
resulted in scores of validation studies during the last two decades 
(Lannholm, I960, 1972). The results of these studies include reconunen- 
■ dations (1) v to establish local norms and (2) to establish separate norms 
for the ethnic groups (Willingham, 1976) . Foreign students who 'con- 
stitute about 6% of the graduate student population in United States 
were neglected in this validation process. Foreign students are required 
to take the the GRE Aptitude test. Their scores are used in a variety of 
selection decesions that affect • their Career and future plans. They 
represent a variety of cultures, languages,' and educational' systems and 
as a group are more vulnerable to test bias than American ethnic groups 

who -have many things in common with the majority group. 

\ ' '* 

The GRE Board became aware of this possible tes^bias a long time 
ago and initiated ,a study of 637 foreign students. The results revealed 
that foreign students scored lower on the GRE .than their American coun- 
terparts. (Pitcher- & Harvey," 1963). Shay and Tseng (1978) found " similar 
results in a study of West Virginia University students. In another 
study, Harvey and Lannholm (1961) found no significant increase in the 
total scores of foreign students on the GRE aptitude test even after one 
year of graduate work at American universities. While a high., discrepancy 
in the performance of American and foreign students on the verbal sec- 
tion of the GRE can be attributed to cultural bias, the discrepancy on 



the GRE quantitative section stems, in part, from the same .cause. The 
Measurement specialists have always emphasized the need to make the 
language of the test a neutral vehicle which is not true for the GRE ap- 
titude .test when given to foreign students. Angelis (1977) , however, 
found little effect of increased language efficiency on the GRE* scores 
„ for non-natives but considered the continious use of the GRE inap- 
propriate for foreign students. 

• Conrad, Trismen, and Miller (l?77) conducted a study of 131* 
minority subjects including foreign students. The results of this studv 
were compared in terms of median r values with the corresponding median 
values computed from GRE validation studies done gn American students 
for the period 1952 to 1.972. The conclusion drawn by the authors that 
the GRE Aptitude test predicts graduate performance of natives and non- 
natives equally well is however, inappropriate because of the small 

t 

sample sizes of subgroups^ on which these comparisons were madef In some 
groups this number was as small as 9. % 

* 

Purpose of the study 

The establishment of separate norms^for the minority group is one 
of- the key recommendations of the Educational Testing Service to in- 
stitutions that use their tests. Most of the schools that attract a 
large number of foreign students lack normative data on this subgroup. 
In the abscence of norms, foreign students are either directly compared 
with their American counterparts or are subjected to a judgemental 
procedure for selection. The present study was designed to investigate 
the predictive validity of the GRE aptitude test for foreign students 



i 

and to help college personnel in establishing differential selection 
criteria for natives, and non-natives. 

Procedure 

All the foreign students enrolled during the last five years at the 
yniversity of Kansas for whom GRE scores were available, were the sub- 
jects in this study. The sample included 148 'students . Information about 
the field of study (Major), the year of initial enrolment hear), sex, 
GPA in the graduate school (GPA) ,' and scores on the verbal (GRE-V) and 
quantitative (fcRE-Q) subs cales of .the^GRE- were collect^ on each stu- 
dent. Nominal variables like major was categorized in/o (1) physical 
sciences and (2) social sciences. Sex had two catego/ies: (l)male and 
^2). female. Year had five levels: (1) 1973 or earlier, (2) 1974, ( 3 ) 
1975, (4) 1976, and, (5) 1977 or later. A composite GRE score (GRE-T) was 
also computed for each student by adding the verbal and quantitative 
Scores together." GPA was used as the criterion while the rest of the 
variables were treated as predictors. 

Two groups, one -of 316,693 American students and another one „ of 
21,881 foreign students, tested during October, 1974 and June, 1976 on 
the GRE Aptitude test, were treated as' national samples 'reppresenting 
populations of American and foreign students', respectively. The 
statistic reported on these grdu>s by^Conrad et al. (1977) was con- * 
sidefed as national norms. Means and standard deviations were computed 
on the GRE scores and the GPA. The statistics obtained ,on foreign stu- 
dents was compared with the national norms of American and foreign stu- 
dents as well as with the statistics reported by Kaiser (1982) on 407 
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American students. The data from Raiser (1982) was also pooled with the ' ' * 
data of this study to test the significance .of mean differences on the 
GRE scores and the GPA between American and foreign students. A t-test' ' 
t was performed to determine the statistical significance. The test, of . ' ♦ 
homogeneity o'f variance was also conducted prior to the t-test to deter- 
mine whether a pooled variance or a separate variance estimate should be 
used in the computation of t values. - . • 

The degree, of relationship between the- GRE scores and the' GPA was 
• determined .by computing zero order correlation coefficients. The 
•strength of 'relationship between the predictors and the criterion was 
investigated across groups of American and foreign students by comparing 
the obtained r values with the corresponding median r values, computed ? 
from "validation studies complsted prior-'t'o 1972 on American students. 
These median r values were reported by Conrad et al. (1977). The ob- 
tained correlation coefficients were also compared with the respective r 
values reported by Kaiser (1982) on the -local reference group of 
American students. v 

Stepwise multiple regression was_ performed on the data to identify 
the 'best composite of multiple predictors for foreign students. Nominal 
variables were dummy coded into (n-l) independent vectors before their 
inclusion int.o the regression equation (Kerlinger & Pedhazer, 1973) . ' 
For major, the subgroup of social sciences «was used as reference group. 
Females were the reference point for sex. Similarly, 1973 or earlier 
was %he reference group for year of enrollment/ The interactions among 

r - 

major, sex, and year of enrollment were included in the analysis by • 
creating dummy coded orthognal vectors. 
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The analysis was performed in two parts.' In the first part, "GRE-V 
and GRE-Q were included as separate predictors in the regression equa- 
tion. In the second part ^the total scores on the GRE were used as a 
single predictor instead ^o^^jKsing verbal and quantitative scores , 
separately. Major, sex, year of enrollment, and their interactions wer/ 
included in both the analysis. , The stability of obtained R values was 
determinedly computing their shrunken values (R) at each step, during 
the development of regression equation. 



Results 



Table 1 sh<5Ws the means and standard deviations for the GRE-V 
GRE-Q, GRE-T, and GPA^on foreign students and local group of American 
stude-nts. 'The performance of national sables of American', and foreign 
students on GRE-V and GRE-Q was also reported in this table. The scores 
of foreign students on verbal and quantitative subscales of the GRE were 
lower than the national « roup of foreign students. The sl^tistics on 
GRE-T and GPA could not be compared due to the abscence of this informa- 
tion on national groups. Foreign students also scored lower than their 
local American counterparts on all the predictors and the GPA. Standard 
deviations were higher for foreign students than local American students 
on all the variables except GRE-V. This findings was consistent with the 
results obtained at national level where national sample of foreign stu- 
dents scored lower means and higher standard deviations on the- GRE com- 

* • 

pared to the national sample of American students. . ' 
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Insert Table 1 Here 



Means of foreign students on the GRE scores ^nd the GPA were tested 
against' means of local American students for statistical significance 
The t-test was applied and the results were recorded in Table 2. The 
test of homogeneity of variance revealed significant differences rn the 
population variances of GRE-Q and the GPA (p < .01). Separate variance 
estimates were therefore, used to compute t statistic for GRE-Q and GPA. 
The t values for GRE-V and GRE-T were" based on pooled variance 
estimates. The t statistic -indicated that the scores of foreign students 
were significantly lower than the scores of American students on all the 
predictors ♦ and the criterion except GRE-Q (p < .01). All the t values 
were based on 555 cases, out of which 148 were foreign students. 



Insert Table 2 Here 



The intercorrelation among the predictors and the criterion . were 
computed to determine the best single predictor of GPA. The results' were 
.recorded below the diagncrl in Table 3. Correlation coefficients on the 
local group of American students, as reported by Kaiser (1982), were en- 
tered above the diagnol in the same table. The last two rows in the 
table show the median r values reported by Conrad et al. (1977) and the 
number, of coefficients used in .computing such values. 

n 
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.The results revealed that the GRE-V was the only significant 
predictor of the criterion for foreign students (p •< .05). The GRE-Q and 
GRE-T were not significantly correlated with the GPA (p > .05). It was 
also observed that r- values between the GRE scores and the GPA were 
higher in magnitude for foreign students than the local American group. 
The correlations between GRE scores and the GPA were however, weaker for 
foreign students than the respective , median correlations on American 
students, computed from last several studies. " 



Insert Table 3 Here 



The- stepwise multiple regression was performed on foreign students 
to identify the best composite of multiple predictors and the accuracy 
with which these predictors can predict the GPA . *Th s e data- was -analysed 
in two different ways. The results of both the analysis were recorded in 
Table A. 
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Insert Table i Here 
« 

The first analysis revealed^that the GRE-V was the best single 
predictor of the GPA for foreign students among the predictors : GRE-Q, 
major, sex, year of enrollment, and their interactions, ftajor was found 
as the second best predictor and the only predictor that significantly 
improved the prediction of the criterion over and above -the prediction 
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t made by the GRE-V (p < .01). The regaining predictors and the .interac- 
tions were not significant (p > .05). "The highest multiple correlation 
of .46 was obtained when all the predictors and their relevant interac- 
tions were regressed on GPA. 

In the second analysis, the regression of GRE-T did not lead to' 
significant overall multiple correlation (p > .05). The value of R was 
Mower than the overall R value obtained in the first analysis by 
regressing GRE^V and GRE-Q together. Major, again, significantly im- 
proved the prediction of GPA (p < .01). 'The rest of the variables were 
insignificant predictors of the criterion (p > .05). The maximum 
variance that could be explained by regressing all the predictors and 
the respective^, two-way interactions was -21.1% which was slightly lower 
than the value obtained in the first analysis- 



Discussion 

V ''. r 



Compared.to American students, lower means and higher standard 
deviations were the characteristics of foreign students, both on local 
indjiational level. High* standard deviations on all the variables except , 
GRE-V Vefer to th^et^erogeneity of the sample. It may be proposed thet- 
foreign sTphSyitAbe divided into more homogeneous subgroups and' that 
separate norms be established for each subgroup. Lower mean and lower 
standard deviation on the GRE-V portraited language difficulty as a com- 
mop problem of all the foreign students., ' V.- 

The cultural bias of tpe GRE Aptitude test for foreign students was ' 
evidenced by. the t statistic. The results revealed that foreign students 
did not s^ore significantly different from American students on .the . 
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GRE-Q, a'^cale which is less influenced by the languag|. However, 
foreign students scored significantly lower than Americans' o| the GRE-V 
which is heavily loaded with language component. Significantly lower 
mean GPA on foreign students may also be attributed to the vlrbal skills 
that dominate graduate 's tudies and for which foreign students were pot 

as well prepared as native speakers. m / $ 

f 

In spite of lower scores on the verbal section and higher potential 
for the verbal subscale to.be culturally biased,' the GRE-V turned out as 

- the best single predictor of GPA - for foreign students. It implied that 
' verbal ^skills are comparatively more important than quantitative skills 
to succeed in the graduate school. The-' "results • "of earliet validation 
studies, conducted on foreign" students, were contradictory as to the 
significance of GRE-V and GRE-Q as predictors, Meberly (I960) found 
.GRE-V as the best single predictor of GPA. Pitcher and Harvey (1963) 
found GRE-V as a significant predictor of .GPA • for the University of 
Florida, GRE-Q for the Unive'rsity of Texas, and GRE-V and GRE-Q both 
significant predictors at Florida State University . and the University 'of 
Illinois: The finding of the present study about the significance of 
verbal scores therefore, cpuld not be generalized neither across the 

' population of foreign students in general nor. to the local population of 
foreign students until similar results are found in subsequent replica- 



tions , 



The next best single -predictor, though not statistically sig- 
nificant was the total score on the GRE (GRfi-T) . The utility of this 
predictor was however, limited due to its redundancy in the presence of 
subscale scores. The relationship of GRE scores with the GPA was in' 
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general, stronger for foreign ^tudents than the local group of American 
students. The lower r values on American studehts were the refeiUt of 
large sample size (n= 407) and thus were more 'stable and reliable than 
those of foreign students. This supposition wak furthel^supported when, 
r values obtained*on foreign students were compared with the respective 

.median r values, reported by Conrad et al. (1977). It was observed that 
the relationshipp between GRE scores and the GPA is weaker for the group 
of •foreign, students than the average group of American students, used in 
the computation of median r values. Weak relationship between GRE scores 
and the GPA suggested t*at the GRE Aptitude test is. not the most ap- 
propriate test to use for foreign students to predict their success in. 

. graduate school . 

During multiple regrsssion analys is , the *GRE-V and major came out 
as the best composite. of multiple predictors,. This finding was' consis- 
tent with the literature that reported GRE scores predicting differently 
for different majors. The general consensus is that the verbal scores 
are a better p'redictor of the GPA for, descriptive majors and quantity 
tiver scopes predict better for symbol oriented disciplines (Lannholm, 
1972; Conrad et al., 1977). Another significant result of this analysis 
'"was the lower predictability -of the total GRE scores compared to-the in- 
dependent use of subscale scores'. Assigning equal weight 'to the verbal 
and quantitative scores was found undesirable. 

r ■ 

Conclusion 



This study was conducted to assess* the .differential predictive 
validity of the GRE Aptitude test. The results revealed that foreign 
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students scored significantly lower on GRE-V, GRE-T, and GPA compared to 
-the local refrence group of American students. The stores on GRE-Q were 
found similar for native and non-native groups. The' zero order correla- 
tions revealed GRE-.V as the only statistically significant predictor of 
the GPA for foreign students. The magnitude of correlations between GRE 
scores and the GPA for foreign students was lower than the median cor- 
relation coefficients, computed from the GRE validation studies comr 
pleted on .American students. Major was found as the most significant 
predictor of GPA; • - - ' * 

'• ' . A 

In the presence of low correlation between GRE^cores and GPA, the 
GRE Aptitude test was 'not considered the most appropriate instrument in 
predicting academic success "of foreign students, ftowever, the sig- 
nificance of verbal scores, as a predictor of GPA, justified its con- 
tinued- use for non-natives. The establishment of separate norms for. 
foreign students therefore, seemed highly desirable to minimize test 
bias caused by their consistently low performance on both the predictors 
and the criterion. High within group variability among foreign students 
suggested the study of subgroups formed oh the basis of -language, cul- 
ture, or g-eograpphic location. 
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TABLE 2 



Sample siz<e, Means, and Standard Deviations on Local and 
National Groups of American .and 
•p Foreign Students 



f ' 1,* 

"1 ; ' Local 

! 1 ' 

j m j Foreign Students 


; LocaJ 

American Students 


National 1 
Sample of* 
Foreign 
Students 


National 
Sample of 
American 

Studonts 

; _ . . 

. 316,693 


1 ■ t , ^ !' s * 
i Vnriablel? ■ 


N = 407 


N r = 21/88* 


: ' [ x 


x . s 


x s 


" X s 


;' GRE-V j «329. 53 - 97. A 3 

J i « 

I IWHf., 51 3.1 1 173.53. 

* > 

| GRE-T* 1 842.63 215.31 
CPA ! 3.33 o.47 

L__ ] 


534.91 98.33* 
525.13 123.37 
1058.92 191.12 
* 3.63 4 0.38 


427 134 
523 * 142 - 



* i 
_J 


516 115 
'528 132 
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TABLE 2 

Test of Means on the GRE Scores and the CPA 
between American and Foreign Students. 



f 





Jest for 
Homogeneity 


j Test 
; Equal 


for 


1 








Means 

i 






Variables 


• ! df 


F 


1 df 




t 


GRE-V 


' U553 


1.0'2 


1 

553 


21 


.81** 


GRE-Q 


1 , 204 


1.96** 


20A 
* 


0 


.77 


GRE-T 


| 1,553 


1.27 


553 


11 


.39** 


GPA 


'j 1,218 


1.59** 


218 


6 


.91*-* 



*P ^_ .05 
**P < .01 
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TABLE 3 



Intercorrolation between GRF Scores and GPA for American 
Students above the diagn'ol, fc ■ '-oreign Students 
boJoti the diagnol, and Median correlations 
J based on Previous Studies 







» 




• 








>. 




j Variables 

i . _ 


j GRE-V 
* 

i 


GRE-Q 


GRE-T 


GPA i 


i 

GRE-V 


! 

j 1.0 - 


i 

.46 


.81 


- .. - ... , 
.14' | 


GRE-Q . 


j 

j .20 

i - 


1.0. ' 


V 

.89 


t 

. 04 


, GRE-T 
f 


! - .61. 

! 


.90 • 


1.0 


..0 j 


•GPA 


.18* 


.08 


.15 


I ; 0 1 


Median r 


.24 


.23 * 


.33 ' 


1 


No. of r's 


46 


43 


'• 30 

t 


.| 



*P < .05 
**P < .01 
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TABLE 4 



Test of Significance of R and Increment in R* 
by ORE Scorers, r>ajor, sox , year of 
Enrollment and Their Interactions 
on Foreign Students 



Variables 



a 2 R" 
R Change 



PART I 



dt 



! \ 

j Tost of 
Test of > | Increment 
<Wora ILK I in 1 R* 

■ + 

'! dr 



F 



-1— 



F 



o rvr.. v 
• * 

GRE-Q 


.I/O? 

.1849 • 


.0342' 


• .0209 


.0022 


j 1 > 1 HO 

2,145 


4 
2 


.826* 
.567 - 


1 i iff 

1 1 , 146 

1 

j 1,145 


4 
0 


.826 
.330 


MAJOR 


.3144 


.0989 


.0737 


.0647 


4, 143 


3 


** 

.922 


j 2,143 
! 


5 


.134 


SEX 


.3144 


.0989 


.0671 


.0000 


5,142 


3 


* 

.116 


I 

! 1,142 

I 


0 


.000 


YEAR 


.!,3394 


. 113 2 


.0575 


.0163 


9,138 

t 


1 


i 

.996 


I 

| 4,138 


0 


.636 


MAJOR*SEX 


. 3784 


1432 


.0739 


.0280 


i 

111 ,136 


J 


* 

.066 


2,136 


2 


.222 


MAJOR* YEAR 


.4398 


1934 


.0737 


.0502 


19,128 


1 


.616 


8,128 


0 


.996 


SEX* YEAR • 


.4616 


2130 


.0745 


.0196 


22,125 


1 


.538 ; 


3 , f25 


r.038 


ART II 






















GRE-T 


.1467 ' 


0215 


'.0^8 ' 


.0215 




>3 


212 


1,146 


3 


.212 


MAJOR 


.3444 


098*9 


.0801 


.0774 


3,144 


.5. .266 


•2,144 


6 


184" 


SEX 


.3W4 . 


0989 


. 0737 


.0000 


4,143 


3. 


** 

92 2 


1 ,143 


0.000 


YEAR 


.3393 


1152 


.0642 . 


r 

.0163 


8,139 


2. 


* 

261 


4 , 139 


0 


640 


MAJOR*SEtf 


.3783 


1431 


.0805 


.0279 


10,137 


2 

( 


« # 
288 


2', 137 


2. 


230 


MAJOR*YEAR 


.4384 . 


1922 


.0795 


.0491 


18,1.29 


1. 


,* 
705 


8,1.29 


0. 


980 


SEX*.YEAR 


14594 • 


2111 


.0796 


* 

.0189 


2J.126 


1 


605 


3,126 


r. 


006 



